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INTRODUCTION 


Statistical  procedures  for  many  problems  have  in  the  past  usually, 
in  fact  almost  exclusively,  assumed  that  the  random  variables  observed 
have  equal  variance-convariance  matrices.  In  practice often  f  inc^sub- 
stantially  unequal  variance-covariance  matrices  arising  in  such  practical 
problems  as  processing  signals  (e.g.,  sonar,  radio,  etc.)  in  noise,  but 
classically  only  imprecise  rule-of-thumb  methods,  or  else  methods  involving 
some  loss  of  information,  were  available  for  these  problems. (e.g. ,  see 

Prokofyev  and  Shishkin  (1974)  _ 

With  the  support  of  the  Office  of  Naval  Research,  Contract  No.  N00014- 
78-C-0543,  (research  was  undertaken  to  develop  the  general  theory  for  solving 

such  problems  and  apply  it  to  important  problems.  Areas  studied  and  results 

r 

obtained  during  the  period  October  1,  1979  to  September  30,  1981  are  summarized 
below.  (Full  results  of  completed  studies  have  been  communicated  in  technical 


reports  to  the  ONR  Statistics  and  Probability  Program  "Basic”  and  "Modeling 
and  Estimation”  distribution  lists.)  Lists  of  publications,  reports  and 
manuscripts  arising  from  the  project  are  then  given. 
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Honors,  awards,  and  other  research  activities  of  the  Principal  Invest¬ 
igator  during  this  period  are  also  summarized. 


SUMMARY  OF  RESULTS 


1.  Heteroscedasticity  in  Quality  Control  Studies 

Analysis  of  variance  (ANOVA)  is  often  used  in  quality  control  studies. 

It  assumes  equal  variabilities  within  groups,  and  no  exact  procedures  have 
been  available  for  cases  with  unequal  variabilities.  Thus,  even  though 
experimenters  are  often  cautioned  that  "the  assumption  of  equal  variability 
should  be  investigated"  (e.g.,  p.  91  of  Cochran  and  Cox  (1957)  or  p.  46  of 
Section  27  of  Juran,  Gryna,  and  Bingham  (1974)),  no  exact  statistical  pro¬ 
cedures  have  been  available  for  dealing  with  cases  where  one  finds  that 
variabilities  are  in  fact  unequal.  In  Bishop  and  Dudewlcz  (1979)  we  illust¬ 
rate  application  of  new  exact  procedures  of  Bishop  and  Dudewlcz  (1978)  for 
* 

ANOVA  when  treatment  variabilities  differ,  using  typical  quality  control 
situations,  with  explicit  control  of  the  power  (as  well  as  the  level)  of  the 
test.  Recommendations  are  given  as  to  when  one  should  abandon  the  common  ANOVA 
procedures  in  favor  of  these  new  ones,  with  an  indication  of  the  costs  one 
may  incur  by  not  doing  so. 
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2.  Multivariate  Ranking  and  Selection 


The  problem  of  selecting  that  one  of  k  multivariate  normal  populations 
which  is  "best"  in  some  precise  sense  is  an  Important  one  which  arises  fre¬ 
quently  in  practice  (e.g.  see  Chapter  15,  pp.  341-394,  of  Gibbons,  Olkln, 
and  Sobel  (1977)).  However,  "The  whole  field  is  as  yet  undeveloped  and  the 
reader  (of  Gibbons,  Olkln,  and  Sobel  (1977),  p.  390]  Is  encouraged  to  regard 
this  chapter  (their  Chapter  15]  as  an  introduction  to  a  wide  area  that  will 
see  considerable  development  in  the  future  as  more  meaningful  models  are 
formulated."  In  Dudewicz  and  Taneja  (1980)  we  have  given  this  problem  a 
new  formulation  which  does  not  Involve  reducing  the  populations  to  univariate 
quantities.  This  formulation's  solution  is  developed  for  known,  and  (using 
the  Heteroscedastlc  Method)  also  for  unknown,  variance-covariance  matrices. 
Preference  reversals  and  arbitrary  nonlinear  preference  functions  are  ex- 
plictly  allowed  in  this  new  theory. 

While  the  nature  of  the  preference  function  is  not  a  chief  point  of 
interest  in  this  paper,  this  work  holds  for  any  and  every  such  function.  The 
specification  and/or  elicitation  of  such  functions  is  part  of  the  field  of 
decision  theory.  Up  to  now  it  has  dealt  with  only  relatively  "simple"  types 
of  functions.  (For  some  illustrative  papers  developing  nonadditive  (but  still 
relatively  simple)  utility  theory,  see  Farquhar  (1976)  and  Flshburn  (1977). 
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For  some  typical  applications  of  this  utility  theory  in  practical  situations, 
see  Giauque  and  Peebles  (1976)  and  Krischer  (1976) .  For  some  consideration  of 
assessment  of  multiattribute  cardinal  utility  functions  see  Kirkwood  (1976). 

For  research  papers  and  a  survey  of  the  field  of  multiple  criteria/objective 
decision  making,  see  respectively  Starr  and  Zeleny  (1977)  and  Hwang  and 
Masud  (1979).)  One  could  investigate  such  specifications  as  (e.g.)  poly¬ 
nomial  functions,  but  no  one  has  yet  been  able  to  do  so.  The  present  paper 
investigates  how  one  can  do  statistical  Inference  with  any  such  function 
(even  if  not  completely  elicited  or  known) ,  and  this  has  been  hitherto  un¬ 
available. 

3.  Estimation  of  the  Larger  Mean 

The  ranking  and  selection  problem  is  well-known  (see  Bechhofer,  Kiefer, 
and  Sobel  (1968)),  and  has  been  the  topic  of  over  1000  papers  since  1950. 

Once  the  decision  has  been  made  as  to  which  of  the  populations  has  the  largest 
mean,  the  question  arises,  "How  large  is  this  largest  mean?"  (For  two  examples 
of  application,  in  hearing  testing  and  weakest-llnk  theory,  see  Blumenthal 
and  Cohen  (1968).) 

In  Dharlyal,  Dudewlcz,  and  Blumenthal  (1980)  we  study  this  problem  and 
enlarge  the  class  of  estimators  of  the  larger  mean. 
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We  Investigate  the  behavior  of  a  class  of  estimators  called  Maximum  Pro¬ 
bability  Estimators  (MPE's)  introduced  by  Weiss  and  Wolfowltz  (1967),  which 
was  first  studied  for  ranked  means  by  Dudewlcz  (1973).  Then  a  new  class 
of  estimators  called  Iterated  Bias  Elimination  Estimators  (IBEE's)  is  intro¬ 
duced  and  investigated,  including  comparisons  with  MPE's. 

4.  Complete  Categorized  Guide  to  Ranking  and  Selection 

While  books  on  ranking  and  selection  (Bechhofer,  Kiefer,  and  Sobel 
(1968);  Gupta  and  Panchapakesan  (1979))  have  become  available  in  recent 
years,  and  have  had  reasonable  bibliographies  Included  in  them,  even  that 
of  Gupta  and  Panchapakesan  (1979)  appears  to  contain  only  about  60Z  of  the 
relevant  papers,  which  number  over  1000.  Also,  these  are  nowhere  available 
in  a  categorized  manner  which  would  make  the  related  research  in  any  sub¬ 
category  easily  available  to  a  practitioner  or  theoretician  needing  it. 
Culminating  an  effort  begun  with  the  issuance  of  "A  Categorized  Bibliography 
on  Multiple-Decision  (Ranking  and  Selection)  Procedures"  by  E.  J.  Dudewlcz 
in  November  1968,  major  new  effort  has  expanded  this  to  an  up-to-date  re¬ 
search  tool,  reviewed  by  over  75  of  the  leaders  of  the  field  in  a  preliminary 


5 


version.  Including  46  categories  and  indices.  This  monograph,  Dudewicz 
and  Koo  (1982),  of  over  600  pages,  appeared  in  1982,  in  time  for  the  First 
International  IPASRAS  (Inference  Procedures  Associated  with  Statistical 
Ranking  and  Selection)  Advanced  Seminar /Workshop,  held  July  1982  at  the 
East-West  Center,  Honolulu,  where  it  was  acclaimed  by  such  leaders  of  the 
field  as  Dr.  Milton  Sobel. 


6 


REFERENCES 


Bechhofer,  R.  E.t  Kiefer,  J.,  and  Sobel,  M.  (1968): 

Sequential  Identification  and  Ranking  Procedures  (with  special 
reference  to  Koopman-Darmols  populations).  The  University  of  Chicago 
Press,  Chicago,  Illinois. 

Bishop,  T.  A.  and  Dudewicz,  E.  J.  (1978):  Analysis  of  variance  with  unequal 
variances:  test  procedures  and  tables.  Technometrics ,  Vol.  20,  pp. 

419-430. 

Blumenthal,  S.  and  Cohen,  A.  (1968):  Estimation  of  the  larger  of  two  normal 
means.  Journal  of  the  American  Statistical  Association,  Vol.  63,  pp. 
861-876. 

Cochran,  W.  G.  and  Cox,  G.  M.  (1957) :  Experimental  Designs.  John  Wiley  & 

Sons,  Inc.,  New  York. 

Dudewicz,  E.  J.  (1973):  Maximum  probability  estimators  of  ranked  means. 

Annals  of  the  Institute  of  Statistical  Mathematics,  Vol.  25,  pp.  467-477. 

Farquhar,  P.  H.  (1976):  Pyramid  and  semicube  decompositions  of  multiattribute 
utility  functions.  Operations  Research,  Vol.  24,  pp.  256-271. 

Fishbum,  P.  C.  (1977):  Multicriteria  choice  functions  based  on  binary  re¬ 
lations,  Operations  Research,  Vol.  25,  pp.  989-1012. 

Giauque,  W.  C.  and  Peebles,  T.  C.  (1976):  Application  of  multidimensional 

utility  theory  in  determing  optimal  test-treatment  strategies  for  strep¬ 
tococcal  sore  throat  and  rheumatic  fever,  Operations  Research,  Vol.  24, 
pp.  933-949. 

Gibbons,  J.  D. ,  Olkin,  I.,  and  Sobel,  M.  (1977):  Selecting  and  Ordering  Popu¬ 
lations:  A  New  Statistical  Methodology,  John  Wiley  &  Sons,  Inc.,  New  York. 

Gupta,  S.  S.  and  Panchapakesan ,  S.  (1979):  Multiple  Decision  Procedures: 

Theory  and  Methodology  of  Selecting  and  Ranking  Populations.  John  Wiley 
&  Sons,  Inc.,  New  York. 


7 


Hwang,  C.-L.  and  Masud,  A.  S.  M.  (1979):  Multiple  Objective  Decision 

Making  -  Methods  and  Applications,  A  State-of-the-Art  Survey,  Springer- 
Verlag  Berlin  Heidelberg,  Germany. 

Juran,  J.  M. ,  Gryna,  F.  M. ,  Jr.,  and  Bingham,  R.  S.,  Jr.  (Editors)  (1974): 
Quality  Control  Handbook  (Third  Edition),  McGraw-Hill,  Inc.,  New  York. 

Kirkwood,  C.  W.  (1976):  Parametrically  dependent  preferences  for  multi- 
attributed  consequences,  Operations  Research,  Vol.  24,  pp.  92-103. 

Krischer,  J.  P.  (1976):  Utility  structure  of  a  medical  decision-making 
problem,  Operations  Research,  Vol.  24,  pp.  951-971. 

Prokof'yev»  V.  N.  and  Shishkin,  A.  D.  (1974):  Sequential  classification 

of  normal  populations  with  unknown  variances,  Radiotehnlka  i  Elektronika 
Vol.  19,  pp.  2635-2638,  Akademija  Nauk  SSR,  Moscow. 

Starr,  M.  K.  and  Zeleny,  M.  (Editors)  (1977):  Multiple  Criteria  Decision 
Making,  North-Holland  Publishing  Company,  Amsterdam. 

Weiss,  L.  and  Wolfowltz,  J.  (1967):  Maximum  probability  estimators.  Annals 
of  the  Institute  of  Statistical  Mathematics,  Vol.  19,  pp.  193-206. 


PUBLICATIONS.  REPORTS.  AND  MANUSCRIPTS 


1.  Dudewicz,  E.  J.  and  Bishop,  T.  A.  (1979):  Analysis  of  variance  with 

unequal  variances,  Technical  Report  No.  193,  Department  of  Stat- 
*  istics.  The  Ohio  State  University,  Columbus,  Ohio.  Published  in 

the  Journal  of  Quality  Technology,  Vol.  13  (1981),  pp.  111-114. 

2.  Dudewicz,  E.  J.  and  Taneja,  V.  S.  (1980):  A  multivariate  solution  of 

the  multivariate  ranking  selection  problem.  Technical  Report  No. 
167a,  Department  of  Statistics,  The  Ohio  State  University,  Columbus 
Ohio.  Published  in  Coanunicatlons  in  Statistics,  Vol.  A10  (1981), 
pp.  1849-1868. 

3.  Dhariyal,  I.  D.,  Dudewicz,  E.  J.,  and  Blumenthal,  S.  (1980): 

Estimation  of  the  larger  mean.  Technical  Report  No.  188, 

Department  of  Statistics,  The  Ohio  State  University, 

Columbus,  Ohio,  July  1980.  Published  in  the  SIAM  Journal 
on  Applied  Mathematics,  Vol  42  (1982),  pp.  1265  -  1275. 

4.  Dudewicz,  E.  J.  and  Koo,  J.  0.  (1982):  The  Complete  Categorized 
Guide  to  Statistical  Selection  and  Ranking  Procedures,  American 
Sciences  Press,  Inc.,  Columbus,  Ohio,v  +  627  pp. 


5. 


Dudewicz,  E,  J.  (1980):  Heteroscedastlcity,  Technical  Report  No.  209, 
Department  of  Statistics,  The  Ohio  State  University,  Columbus,  Ohio, 

July  1980.  To  appear  in  Encyclopedia  of  Statistical  Sciences, 

Volume  3,  edited  by  N.  L.  Johnson,  S.  Kotz,  and  C.  B.  Read,  John  Wiley 
&  Sons,  Inc.,  New  York,  1983. 

6.  Dudewicz,  E.  J.  and  Taneja,  B.  K.  (1980):  Ranking  and  selection  in 
designed  experiments:  complete  factorial  experiments.  Technical  Re¬ 
port  No.  210,  Department  of  Statistics,  The  Ohio  State  University 
Columbus,  Ohio  July  1980.  Published  in  the  Journal  of  the  Japan 
Statistical  Society,  Vol  12  (1982),  pp.  51-62. 

7.  Dudewicz,  E.  J.  (1980):  Estimation  of  the  P(CS)  with  a  computer 
program.  Technical  Report  No.  195a,  Department  of  Statistics,  The 
Ohio  State  University,  Columbus,  Ohio,  July  1980.  Published  in 
Biometrical  Journal,  Vol.  24  (1982),  pp.  297-307. 

8.  Dudewicz,  E.  J.  and  Dhariyal,  I.  D.  (1981):  Optimal  selection  from  a 
finite  sequence  with  sampling  cost.  Technical  Report  No.  146a,  Depart¬ 
ment  of  Statistics,  The  Ohio  State  University,  Columbus,  Ohio,  January 
1981.  Published  in  the  Journal  of  the  American  Statistical  Association, 
Vol.  76  (1981),  pp.  952-959. 

9.  Chen,  H.  J.  (1981):  A  new  range  statistic  for  comparisons  of  several 
exponential  location  parameters,  Technical  Report  No.  234,  Department 
of  Statistics,  The  Ohio  State  University,  Columbus,  Ohio,  April  1981. 
Published  in  Biometrika,  Vol.  69  (1982),  pp.  257-260. 

10.  Lee,  Y.  J.  and  Dudewicz,  E.  J.  (1981):  Robust  selection  procedures 
based  on  vector  ranks,  Technical  Report  No.  233,  Department  of  Statistics, 
The  Ohio  State  University,  Columbus,  Ohio,  April  1981. 

11.  Dudewicz,  E.  J.,  van  der  Meulen,  E.  C.,  Teoh,  K.  W. ,  and  SrlRam,  M.G. 
(1981):  Entropy-based  random  number  evaluation.  Technical  Report  No.  232, 
Department  of  Statistics,  The  Ohio  State  University,  Columbus,  Ohio, 

April  1981. 

% 

12.  Dudewicz,  E.  J.  (1981):  Modern  design  of  simulation  experiments. 

Technical  Report  No.  238,  Department  of  Statistics,  The  Ohio  State 
University,  Columbus,  Ohio,  June  1981. 

13.  Dudewicz,  E.  J.  and  Lin,  W.  T.  (1981):  A  simulation  of  multiple  object¬ 
ive  budgeting  models  using  heteroscedastic  ANOVA,  Technical  Report  No.  250, 
Department  of  Statistics,  The  Ohio  State  University,  Columbus,  Ohio,  Novem¬ 
ber  1981. 

14.  Lin,  W.  T.,  Chen,  H.  J.,  and  Dudewicz,  E.  J.  (1982):  A  simulation  analysis 
for  ranking  and  selecting  the  best  combination  of  production  planning  and 
accounting  control  systems.  Technical  Report  No.  261,  Department  of 
Statistics,  The  Ohio  State  University,  Columbus,  Ohio,  March  1982. 

15.  Beirlant,  J.,  Dudewicz,  E.  J.,  and  van  der  Meulen,  E.  C.  (1981):  Complete 
statistical  ranking  of  populations,  with  tables  and  applications,  Report , 
No.  145,  Katholieke  Universiteit  Leuven,  Department  of  Mathematics,  Leuven, 
Belgium,  December  1981.  Published  in  Journal  of  Computational  and  Applied 
Mathematics ,  Vol.  8  (1982),  pp.  187-201. 


9 


One  copy  of  the  Dudewicz  and  Koo  (1982)  book,  and  several  copies  of  others 
of  the  items  (those  which  were  not  submitted  with  the  1980  Progress  Report 
on  this  contract)  are  appended  to  this  report.  Other  reprints  and  preprints 
are  available  on  request. 

HONORS,  AWARDS,  AND  OTHER  RESEARCH  ACTIVITIES 

Edward  J.  Dudewicz  has  given  colloquium  and  seminar  talks  at  Katholieke 
Universiteit  Leuven  (Department  of  Mathematics) ,  Western  Illinois  University 
(Department  of  Mathematics) ,  Rutgers  University  (Department  of  Statistics) , 
Denison  University  (Department  of  Mathematical  Sciences)  and  University 
of  Texas  at  Arlington  (Department  of  Mathematics)  during  this  period,  in 
many  cases  detailing  the  new  theory  of  multivariate  ranking  and  selection. 

He  has  also  given  an  Invited  Lecture  to  the  Central  Illinois  Chapter 
of  the  American  Statistical  Association;  been  Moderator  of  a  Short  Course 
on  "How  to  Perform  Continuous  Sampling"  at  the  1980  Annual  Technical  Confer¬ 
ence  of  the  American  Society  for  Quality  Control  in  Atlanta,  Georgia,  at  which 
he  also  was  Moderator  of  a  Tutorial  on  "How  to  Test  Normality  and  Other  Dis¬ 
tributional  Assumptions"  by  Samuel  S.  Shapiro,  and  where  he  also  spoke. 

He  was  Organizer  and  Speaker,  Invited  Paper  Session  on  Design  and  Analysis 
of  Heteroscedastic  Data,  American  Statistical  Association  Annual  Meeting, 
Houston,  Texas  (August  1980) ,  in  which  other  participants  were  R.  E.  Bech- 
hofer,  S.  R.  Dalai,  T.  J.  Santner,  and  A.  C.  Tamhane. 


10 


He  was  Invited  Speaker,  as  a  guest  of  the  Statistical  Society  of 
Australia,  at  the  5th  Australian  Statistical  Conference,  University  of 
New  South  Wales,  Sydney,  Australia  (August  1980),  and  spoke  at 
Australian  universities  while  on  this  trip,  including  the  University  of 
Queensland,  and  the  University  of  New  England. 

He  was  accorded  a  1978  Shewell  Award  competition  Certificate  of 
Recognition  for  the  paper  "Design  and  analysis  of  heteroscedastlc  experi¬ 
ments."  Presentation  was  made  at  the  1979  Fall  Technical  Conference  of  CD 
of  ASQC  and  SPES  of  ASA,  held  in  Minneapolis,  Minnesota.  He  has  been  Editor 
of  the  American  Journal  of  Mathematical  and  Management  Sciences  since  1981, 
and  also  serves  as  an  Editor  of  Statistics  &  Decisions. 

Both  E.  C.  van  der  Meulen  and  H.  J.  Chen  participated  in  the  project 
research  activities  during  visits  to  Ohio  State  as  Visiting  Professors. 
These  activities  have  led  to  research  reports,  as  have  those  of  Graduate  Re¬ 
search  Assistants  M.  G.  Sri  Ram  and  B.  K.  Taneja. 


11 


The  accomplishments  of  the  Principal  Investigator,  Dr.  Edward  J. 
Dudewicz,  were  recognized  by  election  as  a  Fellow  of  the  Institute  of 
Mathematical  Statistics  in  1981.  He  was  also  elected  a  Fellow  of  the  Amer¬ 
ican  Statistical  Association  in  1981. 


